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INTELLIGENT MODELING AND CONTROL OF AUTOMATION 

5 BACKGROUND OF INVENTION 

!• Field of Invention 

This invention relates to the automation of the packaging and assembly of 
10 optoelectronics. Specifically, the present invention relates to the provision of 

intelligent control and system level modeling in order to obtain high performance, low 
cost automation of assembly and packagingi 

2. Description of the Related Technolof i y 

15 

The current trend in optical micxrosystem design is to exploit advanced devices and 
new system architectures to achieve greater system performance, such as higher data 
rates or bri^ter displays. Advancements in the optics field may have driven up the 
demand for complicated devices, however the packaging and assembly of these 
20 complicated devices has not increased in sophistication. As a consequence the current 
methods of packaging and assembling optoelectronics do not produce the most 
favorable results. 

Examples of new devices increasing optical capacity are numerous. Research is 
being performed in micro-electrical-mechanical systems CMDEMS), in which micro- 

25 machined mirrors steer an optical signal through a switching network. Next 

generation systems, supportmg terabit/sec conamunication are being designed with 
thin film electro-optic modulators, low-loss hetero-structure waveguides and photonic 
integrated circuits, and high efficiency, edge-emitting, multi-wavelength quantum dot 
laser arrays. Other nanostructures are being used in WDM systems for optical signal 

30 processing, polarization control of VCSEL lasers, all-optical buffers, and micro- 
resonators. Beyond the teleconmiunications field, there have been advances in devices 
for displays and sensors. These include, holographic polymer dispersed liquid 
crystals, photonic crystals, and nano-tubes. 

Although there has been much advancement in the field of complex optical 

35 devices, there has been little to no advancement in the assembly or packaging of these 
products. However, to push towards the theoretical limits of optical microsystems. 
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accurate alignment and packa^Jig of midti-domam systems is required. Packa^g is 
a challenging problenoi, as systems are typically manually aligned. This technique is 
labor intensive, slow, and can lead to a poor performance of the optical system. Even 
with recent progress in the development of devices arid microsystems, the packaging 
5 and assembly of these systems remains as a possible critical limiting factor to their 
commercial success. 

Automation is the key to hi^ volume, low cost, and high consistency 
manufacturing, while ensuring performance, reliability and quality. There is a 
growing interest in the development of automation techniques for photonic edignment 

10 and packaging, as the optical microsystem industry desires the benefits of automation 
experienced by, for example, the semiconductor industry. However, the photonic 
community cannot simply use the same automation processes as the semiconductor 
industry. The equipment is not optimized for optoelectronic packaging automation 
since the optical and geometric axes of these optical microsystems are often not 

15 aligned with one another. This points out the fundamental difference between 
electrical, or semiconductor automation, and optical automation. In the electrical 
domain, a good attachment occurs between two components when they physically 
touch and solder flows between them. However, in tbte optical domain, not only is a 
good connection needed, an exact orientation alignment is required. As a result, 

20 packaging costs currently account for 60-80% of the entire photonic component cost 
The current automation technique used has many limitations. First, if the optical 
wavefront is not a symmetric uni-mode function, the control algorithm can get 
"caught" at local power maximums instead of the global maximum of the entire 
wavefront This error can yield a dramatic loss in power eflBciency, SNR, and BER 

25 for the assembled product Therefore, as the complexity of the optical wavefront 
increases, possibly with the addition of complex devices such as MEMS and 
diffractive optical elements (DOE), thr current technique of alignment might not yield 
maximxmi system performance. 

Secondly, since multi-space searches are employed with a gradient ascent 

30 algorithm, the convergence time of the alignment equipment will depend on factors 
such as the control resolution and processing power. A package with multiple degrees 
of freedom may result in a delayed assembly line, since the gradient ascent algorithm 
for multiple axes is very slow and sometimes non-converging. This increases the cost 
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of the automation process. Lastly, current servos and control (PID) loops deployed for 
seniiconductor equipment do not employ process knowledge base data in the loop. 

Most of the existing photonic automation systems couple laser diodes to fiiber, 
fiber to fiber, or waveguide (on an integrated circuit) to a fiber. The state-of-the-art 

5 technology is based on industrial and semiconductor automation, robotics, motion 
control, sensor technology, and existing capital equipment. For uni-mode optical 
signals, such as Gaussian shaped beams emitted jSrom laser sources, waveguides, and 
fibers, photonic automation is advancing. However, to date, no significant defined 
standard has been developed to implement automation for general optical systems. 

10 Therefore, the majority of production lines for photonic systems are still only poorly 
automated. 

Currentiy, photonic alignment research is performed in academic institutions by 
examining how packaging and alignment can be designed in the system substrate 
through micromachining. In addition, some leading automation and optical 
15 . component companies have realized the importance of automation for photonic 

systOTis. The control loop implemented by these industries is described in and seen in 
Figure 1. 

The technique in Figure 1 is based on a combination of visual inspection and 
maximizing power alignments. This work has shown pronaise for the support of 

20 optical automation for simple uni-modal power distributions, as the Proportional 
Integral Derivative (PID) loops converge to a single mode. The loop 100 in Figure 1 
is called the servo-feedback loop. The servo-feedback loop performs a gradient ascent 
108 on the measured optical power by comparing consecutive power readings Pk and 
Pic.i 1 12 at configurations Xk and Xk-i. A gradient, (PkrPk-i) / (Xk-Xk-i), is formed which 

25 guides the axis motion to the next configuration, Xkn-i: 

^h^I^Xjt+ 7 ((Pk-Pk-i) / (Xk-Xk-O) 

where, r/ is the gradient accent coefficient, which is the resolution of die step. 
30 Currently, the control loop is initiated to a set point (xo) by a vision system 102. 

Key shapes of the fiber or waveguide are searched for in the field of vision of a CCD 
camera focused at the alignment and attachment point. From these searches, the 
automation software "visualizes" the desired link, and initializes the control motors 
with a detennined set point via the initialization loop 104. After determining the 
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vision set point, the alignment is fine-tuned loy the local gradient ascent seaich to a 
local power maximum, as described in Figure I . Each axis of motion is independently 
controlled, and typically, the nxmiber of controlled axes is quite small. To obtain the 
required power measurement, a laser is used to excite the system and a power meter is 
5 attached to the output fiber, this can be seen in step 106. In the event that the system 
is not being aligned correctly the system stops and the alignment is fixed in step 110. 
In efforts to decrease the amount of time to determine the peak power mode, efficient 
positioning algorithms have been implemented, based on the assimiption that the 
power distribution will always be a uni-mode (Gaussian) shape. The algorithm picks 

10 three initial points and measures the power at each. From these results, the algorithm 
determines three new points based on a Gaussian distribution, and continues this 
process until the power peak is found. 

Due to the limitations of the current automation techniques discussed above, 
there is a need for a knowledge based modelirtg process for the automation of 

15 photonic systems in order to reach the potential of the high-capacity optical systems 
in which packaging and automation are keys to performance and cost. 

SUMMARY OF Tg l^.YlVVBlTV ^ 

20 

Accordingly, it is an object of certain embodiments of the invention to provide 
advanced automation as well as inteUigent control to yield high performance, low cost 
automation for packaging and assembly systems. 

A knowledge based model is used to predict the best design, assembly and/or 
25 packaging for a given application, along with a completely automated active optical 
feedback loop for ensuring an accurate and efficient automation of the design, 
packaging and/or assembly of devices. 

In a first aspect of the invention, a system for the design, packaging and 
automated assembly of optoelectronic devices is disclosed. The system includes an 
30 automated device configured for the manipulation and handling of optoelectronic 
device components and a knowledge based model derived firom a set of parameters 
for optoelectronic devices. These parameters can comprise one or more of the 
following; alignment factors, type of assembly task, material type, geometry, 
dimensions, as well as optical characteristics and features of the optoelectronic device 
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and/or its components. There is also a database in v^ch fhe knowledge based model 
is stored for use by the system. 

The system also includes a controller that controls the automated device. 
This controller is enabled to receive information from the database. The controller is 
5 made up of an initial set point device, and a servo*-feedback loop. The initial set point 
device uses the knowledge based model for setting an initial set point. The servo- 
feedback loop begins at the initial set point and controls the movement of the 
optoelectronic components. A measuring device is used for taking measurements in 
the system. These measurements are used by the servo-feedback loop to adjust the 

10 movement of components in the system. 

In a second aspect of the ivention, a method for the design, packaging and 
automated assembly of optoelectronic devices is disclosed. The method includes the 
steps of pro\ading an automated device configured for the manipulation of 
optoelectronic device components, determining an initial set point using a knowledge- 

15 based model of the optoelectronic device, providing the initial set point to a servo- 
feedback loop, positioning the device to the initial set point, obtaining a measurement 
of fhe system with a measuring device and then using the measurement to adjust the 
position of one or more of the optoelectronic device components. 

These and other aspects of the present invention will be apparent from the 

20 detailed descriptions of the invention, which follow. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 Fig. 1 shows a prior art method for performing automated optoelectronic packaging. 
Fig. 2 shows an overview of the system of the present invention. 

Fig. 3 shows an overview of another embodiment of the sy^em of the present 
invention including a learning loop. 

Fig. 4 shows an e3q)anded breakdown of the knowledge-based method of the 
30 present invention. 

Fig. 5 shows a diagram of simple model based control. 
Fig. 6 shows a diagram of a learning model identification technique for a 
learning loop. 

Fig. 7 shows a diagram of simulation of a leamir^ loop technique for two 
35 unknowns. 
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Fig. 8 shows a setup of laser diode-aperture-fibier coupling. 
Fig. 9 shows intensity cross-sections of plane wave propagation past an 
aperture 22.5, 56.25 and 225 |xin. 

Fig. 10(a) shows a contour diagram of the power coupled in an 8 |xm fiber a 
5 wave firont. 

Fig. 10(b) shows an intensity contour of a wavefiront propagated 22.5 pm past 
a 30 \im aperture. \ 
Fig. 1 1(a) shows a star coupler. 

Figs. 1 1(b)- 1 1(c) show optical intensity contours three dimensions and two 
10 dimensions for the star coupler of Fig. 1 1 (a). 

Fig. 12 shows a comparison of tlie knowledge based model control method of 
the present invention to a conventional aligmnent control method in both two- 
dimensional and three-dimensional graphs. 

Fig, 13 shows an iterative time-step comparison of the knowledge based 
15 model control system of the present invention to the conventional alignment control 
method employed in Figure 8. 

Fig. 14 shows fiber array aligniixent of the hill climbing algorithm and the 
knowledge based model control loop. 

Fig. 15 shows a model of the edge emitting leiser coupled to a fiber. 
20 Fig. 16 shows a chart showing the power distribution simulation at the fiber 

interface. 

Fig. 17 (a) shows a diagram of ttie power contour. 

Fig. 17(b) shows an intensity diagram showing the gradient ascent algorithms 
for both the instant invention's model and a currently used model. 
25 Fig. 18 shows a diagram of the control process including the feed-forward 

loop, and simulation results for the specific laser-to-fiber example. 



DETAILED DESCRIPTION 

30 

1. System Overview 

The system and method of the present invention can be used in the automation 
and assembly of a variety of optoelectronic devices such as couplers, fiber optic 
cottiers, fused biconical tapered couplers, switches, optical switches, wave-division 
35 multiplexers, filters, attenuators, polarizers, waveguides, sensors, fiber optic sensors. 
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connectors, fiber optic connectors, pigtails, fiber optic pigtails, patch cords, fiber optic 
patch cords, transmitters, fiber optic transmitters, receivers, fiber optic receivers, 
amplifiers, an optical amplifier, a fiber optic amplifier and other s imil ar devices 
and/or components. 

5 By using a knowledge based model packaging and assembly technique for the 
automaiiuu uf photonic systems, the system of the present invention overcomes 
certain limitations of current photonic automation systems. This knowledge based 
model automation technique reqiiires accurate and efficient optical models. In that 
respect, the system preferably employs validated existing optical models and/or new 

10 advanced models for complex devices and systems. 

Knowledge based models provide a new paradigm for photonic automation. 
Previous device and process knowledge are exploited in on-line control loops to 
optimize design, assembly and packagir^ of devices such as optoelectronic devices. 
Not only will this decrease the cost of system assembly and packaging, including 

15 alignment, this technique will employ existing capital equipment tnfiiastructure (from 
semiconductor and industrial automation) and increase the system performance in 
terms of bit error rate (BER), signal-to-noise ratio (SNR), insertion loss, cross-talk, 
and coupling. As device and system designs become more complex, the advantages of 
this technique will be magnified. 

20 Figure 2 shows a general overview of one embodiment of a system in 

accordance with the present invention. Controller 200 is comprised of an initial set 
point device 202, and a servo-feed loop 204. Controller 200 may typically be a CPU 
or other processuig device that is coimected to the overall assembly system. 
Alternatively, controller 200 could be comprised of apluraUty of processors 

25 connected to the system via the Intemet, or by wireless connections. 

The initial set point device 202 employs a knowledge-based model 210 
received from a database 208 in order to calculate the initial set point Xo used by the 
system. In one preferred embodiment, the knowledge-based mode 210 is an optical 
power propagation model. However, other optical waveforms characteristics and 

30 features can could alternatively be employed as the basis of the knowledge-based 
model 210, or as a portion of knowledge-based model 210, in order maximize the 
efiSciency of the system. Other features or characteristics can be, for example, optical 
intensity, optical phase, optical polarization and combinations thereof. The database 
208 can be a CPU, or can be comprised of on-line storage devices. The database 208 
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can be maintained at a separate locality firom the assembly and be opiated 
independently to supply the model 21 0 to various systems located at dififerent 
locations. The controller 200 could then download the appropriate model 210 when 
needed. Alternatively the database 208 could be stored on the same CPU as the 
5 controller 200. 

Ihe servo-teed back loop 204 uses the initial set point Xo and at least one 
measurement obtained from the measuring device 206 to operate the automated 
device 212. The measxirement obtained is typically that of an optical feature or 
characteristic such as optical power, optical intensity, optical phase or optical 

10 polarization, and can be measured in a variety of maimers. Altematively one or more 
other measurements could be made by the system and the set point could be 
estabUshed based upon that measurement or a combination of different measurements. 
A measurement could be made of the optical intensity, optical phase, optical 
polarization, and combinations thereof. The automated device 212 then operates to 

15 assemble the components of the device. An artisan familiar with the assembly and 
packaging of optoelectronic devices would be familiar with the range and scope of 
suitable automated devices that can be used by the system for packaging and 
alignment of components. 

Figure 3, shows an alternative embodiment of a system in accordance with the 

20 present invention. This alternative embodiment additionally includes a learning loop 
314. Controller 300 comprises an initial set point device 302 and a servo-feedback 
loop 304, however it also includes learning loop 3 14. Learning loop 3 14 operates 
within the system to help control the automated device 3 12 in an improved manner. 
The controller 300 will receive a knowledge-based model 310 from the database 308, 

25 and the initial set point device 302 will use the knowledge-based model 3 10 to 

provide the initial set point Xq. Learning loop 314 monitors measurements taken by 
measuring device 306 and compares the values in order to improve the set point 
determination based on the knowledge-based model 3 10 for future device assembly. 
This permits the system to make improvements to tiie knowledge-based model 310 

30 based upon actual conditions occurring during the assembly process. 

Although the operation of the system is detailed above, ftirther detail will be 
provided about the knowledge-based model 310 below. The overwhelming majority 
of currentiy deployed control loops are of the simple feedback type, including 
Proportional (P), Proportional and Integral (PI) or Proportional, Integral, and 
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Derivative (PID). However, in addition to the feedback module, the Model Based 
Controller of the present invention includes a '*feed-forward" element, which 
determines tiie initial set point The feed-forward element is typically based upon a 
priori knowledge regardii^ the process to be controlled. Such a controller is denoted 
5 as a "Model Based Controller." This family of controllers includes: Model Reference 
Adaptive Control (MRAC), Intemal Model Control (IMC), Model Predictive Control 
(MPC), and Intelligent Control such as Expert Control, Neurocontrol, and Fuzzy 
Logic Control. 

Figure 4 shows an expanded breakdown of the Model Based method 
10 employed by the system of the present mvention. As seen in the figure, there are 
three main components of the control algorithm. The innermost servo-feedback loop 
414, shown in Figure 4, functions in a similar maimer as the servo-feedback loop, 
servo-feedback loop 414 can be an off^the-slnelf servo feedback loop, typically a PID 
controller. The servo-feedback loop 414 performs a gradient ascent 408 on the 
15 measured optical power P and attempts to converge on the local maximum optical 
power by comparing consecutive power readings Pk and Pk-i 412 at configurations Xk 
and Xfe.i. Once convergence is complete, the system proceeds to stop motion step 416. 
A gradient, (Pk-Pk-O / (Xk-Xk-i), is formed which guides the axis motion to the next 
configuration, Xk+i: 

20 

Xifc+/-x^+ ^7 ((P^Pm) / (xa^xm)) 

where, tj is the gradient ascent coefiScient, wiiich is the resolution of the step. Motion 
control step 410 performs the function of adj listing the optical components based on 

25 the output of servo-feedback loop 414, However, in this case, the servo-feedback loop 
414 is initialized with a different, more advanced set point Xo, as described below. 
The feed-forward loop 405, denoted (B) in Figure 4, jprovides the servo-feedback loop 
414 witih a "smart" initial set point to track. There can be a visual inspection and 
manual aligmnent 402, but use is also made of an optical power propagation model 

30 403. The *'smart" set point is selected by the initialization loop 404 on the basis of a 
properly derived, optical power propagation model 403, which can be stored in a 
database or computed on-line. The optical power propagation model 403 is device and 
assembly task specific, that is, different devices with different aligmnent and 
assembly tasks will possess unique power distribution fimctions. As new assembly 
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tasks are submitted to the control machinery (e,g-, inputs to the feed-forward block), 

the model 403 is activated and generates a new set point for the inner servo-feedback 

loop 414 to track and lock onto. This information is used in the initialization loop 404. 

It is emphasized that Xo generated by the knowledge based model control method, in 
5 general, is different from the value of Xo presently produced by the controller seen in 

Figure 1 . IMs new Xo position forecasts a knowledge based model nominal 

configuration for maximum power transfer. 

The knowledge based model control method can be derived from a set of 

known parameters for the optoelectronic device. For example, an optical power 
10 propagation model can be derived from set of one or more of the following 

parameters for optoelectronic devices: alignment factors, type of assembly task, 

material type, geometry, dimensions, design tradeoffs and the assembly apparatus. 

Therefore the system can take into account a wide range of environmental factors as 

well as assembly and automation factors in developing the control method. This 
15 information can be used for the optimization of the design of the automation'system 

itself and/ or the components of the device. Assembly machinery can be adjusted as 

well. 

In an altemative embodiment the system of the present invention fiirfher includes a 
learning loop 418. Learning loop 418 is preferably the outermost loop in order to 

20 provide opportunities for the system to improve upon its knowledge-based model and 
adjust its accuracy on the basis of "experienced evidence" or a mismatch between 
expected power and measured power at a specific axes configuration. The learning 
loop is preferably only activated at a lower sampling frequency for specific and 
appropriate tasks. The data received by moving to set point Xk using the motion 

25 control loop and the measuring of the power when Xk is reached is used by both 
the servo-feedback loop 414, and the learning loop 418. The learning loop will use the 
data in its learning algorithm and model parameter adjustment. The learning loop 
41 8 can employ measurements of optical power, alignment factors, material features, 
geometry and dimensions to adjust the knowledge based model. The learning loop can 

30 also use statistical quality control or field data based on experience of handling the 
device itself. A manufacturing database can be updated based on information gathered 
during use of the machinery or maintenance, or observations made from other similar 
systems employed in the automation of the packaging and assembly. Learning loop 
418 is further explained with respect to Figures 5-7 discussed below. 
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Figure 5 shows the control algorithm block diagram of the feed forward loop 
405 and feedback loop 41 4* The feed forward loop 405 is defined by the equation 
shown in Figure 5. Feedback loop 414 and its defining transfer function are also 
shown in Fig. 5. In the figure, the input is Optical Power Desired, and the output 
5 is Optical Power Received, Pr- The control plant is denoted as P, and the gain is noted 
asKp. 

To effectively tise the knowledge based model control, models of the control 
plant, P , and its inverse, P must be determined for feed forward loop 405. If done 
accurately, feed-forward loop 405 can position the mechanics in the vicinity of the 
10 globally optimal configuration. If P = P, where P is the actual behavior of the plant, 
perfect tracking can be obtained, mathematically shown by multiplying the transfer 
function of the two sub loops together: 

^HHxy^^K, ij^ i^K^Hx) 

As seen, feed forward loop 405 relies on accurate models to determine the set point. 
15 Therefore, the optical power propagation model is important in providing accurate 

models and learning loop 418 plays a role in providing an accurate power propagation 
model. 

In the systems that are to be automated, the structure of the systems and all of 
its parameter values are assimied to be known. Optical propagation models are then 

20 used to derive a mathematical representation of the system. Often, all of the required 
information is not available, or models could have inaccuracies. In such a case, a 
system model can be approximately determined firom experimental measurements of 
available inputs and outputs. When the structure of the xmknown system is known, but 
certain parameter values are unknown, system identification is reduced to a problem 

25 of parameter identification. This identification technique is explored below with 
respect to opto-electronic automation. 

An angular spectrum technique is used to model optical propagation between 
system components, including optical sources, fibers, devices, apertures, and 
detectors, due to its accuracy and computational efficiency. The angular spectrum 

30 technique is an exact solution to the Rayleigti-Sommerfeld formulation, a scalar 
modeling technique without near and far field approximations. The technique is 
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implemented by performing a Fourier transform on the complex optical wavefront 
transforming from the spatial domain to the frequency domain, multiplying these 
frequencies by a transfer ftmction describing the propagation medium, and returning 
to the spatial domain with the use of an inverse Fourier transform. However, there are 
5 possible sources of errors in the optical modeling technique. The first is tiie use of a 
discrete Fourier transform in place of a continuous Fourier expression. Other errors 
can be found due to aliasing and sampling conditions. 

To combat possible errors in the knowledge based model, learning loop 418 is 
implemented to improve the models that are used for control functions. The learning 

10 model identification for learning loop 418 is activated at a lower sampling frequency 
for specific and appropriate tasks. This technique provides opportunities for the 
system to improve upon its power model and adjust its accuracy on the basis of 
"experienced evidence" or a mismatch between expected power and measured power 
at a specific axes configuration. Details of the learning identification technique for 

15 learning loop 41 8 are explained below. 

The system to be identified is described by y = /(y, u, J3) , where y is the output, 
u is Ihe input, and ^ is a vector of all of the unknown parameters. A mathematical 
model with the same form, with different parameter values , is used as a learning 
model, such that y = f(y,u,fi) . The output error vector, e, is defined as e^y-y. The 

20 goal of the learning loop is to manipulate p such that the output is equal to 2:ero. The 
implicit assumption is that e is determined entirely by and is zero when>5 = J3. It 



follows that e = eifi) and e 



The Lyapunov fimction, v(e)^ is used to determine the stability of the system. In this 
case, v(e) is selected as a positive definite fiinction of ^ (that is, if v(Q)=0 then v(e)>0 

25 for all e?fiO) and is defined as v(e)-^e'^Qe^ where jg is a symmetric matrix. 
Therefore, the derivative of ttie fimction is H^) = e^Q^fi . If v(e) could be made 

negative definite (that is, if v(0)=0 then v(e)<0 for all 0) by properly choosing >§ , 

then e would approach zero asymptotically. Selecting >§ = -f("^)^ge, with ^ as a 

dfi 

positive scalar constant, gives a negative semi definite (that is, v(e)^0 for aH e^G) 
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expression v(e)=-fie^fi(-4)(-~l-)^fic. Even though not negative definite, this learning 

dfi dp 

model technique for learning loop 418 is capable of providing system identification in 
many cases. 

Before this can be implemented, the sensitivity matrix, must be 

AO 

5 computed, y does not depend on p , therefore, — ^ = S . Since the initial 

dp 

conditions for tiie model KO) can be selected indepeadentiy of >8(0) , the initial 
condition for the sensitivity matrix 5 is 5 (0) = [0]. Thie learning model adjustment 
scheme consists of assuming initial values for >§(0) , adjoining the sensitivity 

equations to the model equations and using p = -aS^ge . The learning model 
10 identification technique for learning loop 41 8 can be visualized in terms of the control 
diagram shown in Figure 6. 

As in all gradient adjustment schemes, the parameter s must be properly 
selected. If ^ is too large, the schemes will diverge, and if is too small, then p will 
approach p very slowly* General conditions under which this technique converges 
15 are difficult to determine analytically. Selection of a suitable s and the weighting 
matrix Q are determined by a trial and error process. 

To show an example of this learning identification theory for learning loop 
418, a system with two unknown variables having an input-output dijBFerential 
equation y^c^^Ku is discussed below. In this exanaple, a and K are unknown (i.e., 
20 need to be learned), and the variables u, 7, and y can be measured. Using the 
learping identification theory discussed above, the eqtiations necessary to implement 
the learning model identification scheme are y^x^ and y-x^,^ resulting in the 

derivate of the state variable x = j^^ - ^ system, an estimated model 

of X = + jw is used; therefore, the error is defined as e = ;c - Jc . The necessary 



25 sensitivity coefficients are contained mS^ 



where fi = [y-j> y-^ y 
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da da dK dK 

The initial conditions on all four sensitivity equations are zero. Figure 7 gives the 
simulation dis^ram for this method. 

Using a knowledge based model control technique provides many advantages 

5 ever current automation techniques. For cAsunple^ ihe technique can support the 
packaging of systems not emitting optical power in an ideal uni-mode power 
distribution. Therefore, if the optical power distribution lias many peaks and valleys, 
using a knowledge-based model enables prior knowledge of which peak will 
nominally contain the most optical power. From the position of the power peak, 

10 optimal alignment can be obtained, as the control loop a*voids finding and being 
positioned in local power maximums. Unavoidable errors, such as manufacturing 
errors and misalignments, will be partially corrected with a PID feedback loop, found 
in addition to the feed-forward loop. An additional advantage of the technique, when 
compared to today's standards, is the time tiiat the autonaation control loop takes to 

15 track the peak power position. It can greatiy decrease this time with the feed-forward 
block of the algorithm. Using advanced simulations, an initial position that is close to 
the optimal position can be found. Therefore the system does not have to search tiie 
complete optical field space. .This reduces the required field of view and required 
resolution, which can low^ the cost of the automation sensors, software, and 

20 hardware. Also, as tiie number of packages to be assembled increases, tiie packaging 
time of an individual device is critical. This time directly effects the packing time of 
the entire lot of devices, which is an important cost factor for large manufacturing 
runs. 

For example, having prior knowledge of how tilts of the fiber or waveguide 
25 affect the performance of tiie system is important. Tilts are the most challenging 
aspect of alignment using the current methods. To use gradient ascent to position in 
the X and y directions is fairly straightforward for a uni-mode optical power 
distribution. However, when adding the complexity of tilts into the alignment, the 
control loop dramatically slows down as the nimiber of parameters required to 
30 optimize the alignment position increases. With the knowledge based model control 
algorithm, the system can reduce the costiy tune of optinaizing tilted, and more 
generally, miilti-axis systems. 
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2. Optical modeling techniques 

a. Rayleigh-Sommerfield technique 

As part of the kaowledge based model control system for the automation of 
photomc devices, there is a need to perform accurate, yet efficient, optical modeling 
5 for the feed-forward portion of the control algorithm, in this section, an optical 

modeling and simulation technique that is used in the system of the present invention 
is described in detail. 

When optical wavefironts interact with the small feature sizes of micro- 
systems, many of the common optical propagation modeling techniques become 

10 invalid, and full vector solutions to Maxwell's equations are required for accurate 
simulation. However, these accurate solutions are computationally intensive, making 
interactive simulation between the control loop and the optical modeling tool almost 
impossible. To reduce the computational resources of modeling the optical wavefront 
in free-space by the vector solutions, a scalar representation can be used. For 

15 example, the Rayleigh-Sommerfeld formulation can be employed. The Rayleigh- 
Sommerfeld formulation is derived from the wave equation for the propagation of 
light in free-space from the aperture plane 77, 0 to a parallel observation plane 
(x,y,z). The Rayleigh-Sommerfeld formulation is mathematically shown below: 

20 U (x,y,zM^jV // rj.O) (expOAr))//^S^7 
S 

where, r=(2^ 4- (x-7jf + O^^)^^, 2 is the area of the aperture, and z is the distance 
that tihe light is propagated from an aperture plane (z — 0)to the observation plane. 

25 The formulation is valid as long as both the propagation distance and the aperture size 
are greater than the wavelength of light These restrictions are based on the boundary 
conditions of the Rayleigh-Sommerfeld formulation, and the fact that the electric and 
ma^etic fields caonot be treated independently at the boundaries of the aperture. To 
compute flie complex wavefront at the observation plane, each plane is discretized 

30 into an NxN mesh. Using a direct integration technique, the computational order of 
the Rayleigh-Sommerfeld formulation is OCiS/"^). In the interest of reducing the 
computational load of using a full scalar technique, the Rayleigh-Sommerfeld 
formulation has been recast using an angular spectrum technique. 
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b. Angular Spectrum technique 

As an alternative to direct integration over the sxjrface of the wavefront, the 
Rayleigh-Sommerfeld formulation can also be solved using a technique that is similar 

5 to solving linear> space- invariant systems. R.e-exam!ning the R^yleigh-Scmmerfeld 
formulation, it can be seen that the equation is in the form of a convolution between 
the complex wavefront and the propagation through free space . The Fourier 
transform of the complex optical wavefront results in a set of plane waves traveling in 
different directions away from the surface. Each plane wave is identified by the 

10 components of the angular spectrum. At the observation plane, the plane waves are 
summed together by performing an inverse Fourier transform, resulting in the 
propagated complex optical wavefront at the observation plane- 

To solve the Rayleigh-Sonmierfeld formulation with thie angular spectrum 
technique, flie complex wavefront at the aperture plane is first examined. The wave 

15 fimction U(x,y,z) has a 2D Fourier transform, A(Vx,Vy, 0), in tenris of angular 
frequencies, Vx and Vy. 

A(vx,Vy, 0) = ff U{x,ySi) exp[":/2;r(vjoX +yyy)] dxdy^ where = sin Q^IX and , Vj,= sin 

From the equation, the plane waves are defined by exp[-j2;r(vx>3c +Vy y)] and the 
20 spatial frequencies define the directional cosines, sin (9^0 sin (9y), of the plane 
waves propagating from the origin of the aperture plane's coordinate system. 

The free-space transfer function in the frequency domain has been computed 
by satisfying the Helmholtz equation with the propagated complex wave function, 
U(x,y,z): 

25 

A(vx,vy,z) =^A(vj,Vy,0) exp{jz2;r(lA^ - v/- Vy^f^} 

This describes the phase difference that each of the plane waves, differentiated by the 
spatial frequencies, experiences due to the propagation between the parallel planes. 
30 Therefore, the wave function after propagation can be transformed back into the 
spatial domain with the following inverse Fourier transform: 
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U(x,y,z)- liA(vx.Vj,0) exp{/z2;r(lA^ - v/- v/)^} exp[/2^Kx ^Vyy)] dv^dvy 

The advantage of using the angular spectrum to model light propagation is that the 
method is based on the Fourier transform. The computational order of the FFT for a 
2D input is 0(N^ Iog2N), which allows for simulation to be performed on-line in the 
imowiedge based model control loop. 

The techniques discussed above are not exclusive of the techniques available, 
and other methods of developing knowledge-based models could be used within the 
scope of the present invention. In the preferred embodiment Rayleigh Sommerfeld 
formulation or an angular spectrum solution to the Rayleigh Sommerfeld formulation 
is used. However, Ray analysis or Gaussian analysis (Salech, B.E.A. and Teich, M.C,, 
Fundamentals of Photonics fsee Wiley, New York), 1991, or Far (Fraunhofer) Field 
analysis or Near (Fresenal) Field analysis (see Hecht, E., Optics. Second Edition 
(Addison-Wesley Publishing Company, 1987), or these methods can be used as a part 
of the knowledge based model in the development of the automation. Also vector 
solutions to Maxwell's equations (see Scarmo22ino, R., Osgood, R.M., Jr., 
"Comparison of finite-diflference and Fourier-trans-form solutions of the parabolic 
wave equation with emphasis on integrated-optics applications," Journal Optical 
Society of America A, Vol. 8, No. 5, May 1991, pp. 725-73 1) can be used. 

3. Examples 

To highlight some of the advantages of the knowledge based model, here are 
some examples comparing the knowledge based model to current, state-of-the-art 
alignment algorithms. Examined below is the coupling of a wavefront into a iBber in 
the near field and a more complex system coupling the output of a diffractive element 
into a fiber array. First a discussion of the equipment setup is presented. 

Eattipment Set Up 

A diagram of a sample test bed 800 is shown in Figure 8. The sample test bed 
800 is illustrative of a possible bed that may be used in combination with Examples 1- 
4 described in detail below. Figure 8 shows a diagram of optical table 810, which is 
an XY table, an X servo motor 814, a Y servo motor 812, an X encoder 816, a Y 
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encoder 818, amplifiers (not shown), DAQ (data Acqxiisition) 824, an optical power 
meter 826, a laser diode driver 828, a pigtailed laser diode 830, and a DSP-based 
motion controller board 820 from Precision Microdynamics Jnc™ The MC8000 
motion control board 820 uses a 32-bit floatia^ point DSP that performs path 
planning, feedback regulation and other real time computations, freeing the host PC 
for process application. Ihe card supports data rates with the host PC as high as 7.2 
Mbytes/s. 

Servo motors, 812, 814, are manufactured by BEI™, and are typical "inside- 
out" brushless DC (BLDC) motors which provide greater oiitput power, higher 
operating speeds and cleaner, quieter operation than brush-type counterparts. Motors 
812, 814 are ideal for sterile environments, since there are no brushes and no 
particulate is discharged. Because of their inherent reliability and long-term service 
life, BLDC motors can significantly contribute to lower overall cost of operation and 
maintenance. The amplifier (not shown), made by AMC™, is a Pulse Width 
Modulated (PWM) trans-conductance amplifier with a gain of 2.85 AmpA^olt and 
supply voltage requirement of 70V. The Heidenhain™ LIP 403 A encoders, 816, 818, 
have a grating of 2 jum and maximum speed of 6 m/min, with a sinusoidal output. 

The motion control card receives position commands issued by the PC 
software from feed forward loop 405. Computer 822 calculates a series of positions 
for each axis along the desired path at the desired speed set by the feed forward loop 
405. The motion control card adjusts the signals to the servo amplifiers accordingly, 
such that servomotors 812, 814 follow the desired path. To make sure that the desired 
path is followed and the loop is closed, the motion control card repeatedly checks the 
actual position of the machine's axes obtained from encoders 816, 818 against the 
commanded position and makes adjustments to keep the difference as small as 
possible. 

The complete system set-up to couple an optical fiber to a laser source is 
shown in Figure 8. OpticaUy, 680, 1330, and 1550 nm pig-tailed laser diodes 830 are 
coupled to single mode fibers, a 501 Newport Driver, and an 1830-C Newport Fiber 
Receiver are used. The receiver is GBIP interfaced to the computer control. 
Pigtailed laser diode 830 is attached to the non-movmg test bed structure, while the 
receiver fiber is attached to the controlled optical table 810. The optical power 
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sensor reading is sent to the computer control, which controls the system for position 
measurement to attach at the point of maxinnim power. 

Example 1; Near Field Alignment 

5 Tn this example, the coupling of a plane v/avc propagating ttiroagu a 30^ 

square aperture and an 8 ixm fiber in the near field is examined. Under these 
circwnstances, the system of the present invention provides better performance than 
the current automation method. As discussed above, current aligmnent automation 
techniques determine an initial set point through the visualization of the position of 

10 the fiber relative to the aperture, and aligmnent of the geometrical optical axis with 
center of the fiber core. From this set point, the gradient ascent algorithm is performed 
to find the positional alignment that provides the maximum power coupled into the 
fiber. For a square aperture system in which the optical wavefiront has propagated into 
the far field, the wavefiont power distribution will be a sine fimction in the x and y 

15 directions, with a power maximum at the geometric center of the system. Therefore, 
the visualization set point would lead to an attachment for the coupling of maximum 
power into the fiber. 

However, if the optical wavefront has oxily propagated into the near field, the 
wavefront appears much different than that of the far field pattern, and attachment at 

20 the optical geometric axis will lead to a poor system performance. Demonstrating fiie 
difference between the near field and the far field. Figure 6 shows a cross-section of 
the intensity distribution of a plane wave propagating past a square aperture 22.5, 
56.25, and 225 |im. As the wavefront propagates ftirther past the aperture, it starts to 
move from the near field to the far field as a "Gaxissian-like" shape begins to appear 

25 in the center of the wavefront. At the top of Figure 6, a diagram of the plane wave 
propagating through an aperture is included. 

Using the knowledge based model to determine the positional alignment for 
the maximum power coupled into the 8 |mi fiber at a distance of 22.5 jim past the 
aperture, the entire system is simulated to predict the best feed-forward set point for 

30 the control algorithm. The simulation is performed using the angular spectrum 

technique for solving the Rayleigh-Summerfeld formxilation discussed above, since 
the output intensity distribution and a distribution of the power coupled into the fiber 
are determined. From the power distribution, the position of the max-i'TTnim power 
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value is scanned for, which becomes the feed-forward set point in the knowledge 
based model control algorithm. The graph of the power distribution into the jfiber is 
seen in Figure 10(a), and the feed-forward set-point is approximately (7,7) fxm. The 
intensity contour of a wavefiront propagated 22.5 jxm past a 30 pm square aperture is 
5 shown in Figure 10(b). 

In Figure 10(a), the coupling of the fiber using the current state-of-the-art 
technique and the knowledge based model control algorithm is also compared. The 
classic technique starts at a position close to the center of the geometrical optical axis 
and uses the gradient ascent algorithm, which stops the alignment loop at a local 

10 power maximum, denoted by the "X" in the figure. In contrast, the knowledge based 
model control technique starts at the feed-forward position (in this example, it 
actually starts off of the set point by a couple of microns to simulate possible 
mechanical and system misalignments) and uses a gradient ascent algorithm to find 
the global maximum of power coupled into the fiber, denoted by the '*0" in the figure. 

15 The paths of the gradient ascent algorifluns for both the instant invention's 

method and the classical method are included on the intensity diagram. In this 
example, an increase in system performance of approximately 1 8% is achieved when 
using the knowledge based model. The knowledge based model peak does not just 
find the maximum intensity peak, it examines the entire power distribution, and finds 

20 the best system performance. 

Example 2: Fiber Array Automation 

In this example, an automated process for aligning and attaching a fiber array 
to a star coupler is examined. The star coupler is shown in Figure 1 1(a). An array of 

25 8 fibers is coupled to the waveguide outputs of the star coupler. Hie spacing between 
the waveguides and the fibers in the fiber array are matched to increase system 
performance. To make the system more realistic, the star coupler input is excited with 
an optical pulse, with a tilt of 2 degrees, which is a tilt misalignment that can be 
reasonably expected to occur during use of current semi-automatic assembly 

30 processes. With the use of simulation the output wavefix)nt that is expected firom the 
star coupler can be determined. The 3D and 2D cross-section intensity contours, 
simulated in RSoft's BeamProp, are shown at tiae edge of the output of the star 
coupler. These results are also seen in Figures 1 1(b)- 1 1(c). 
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) 

As in Example 1 above, the current industry standard is first performed, for 
alignment and packaging automation for comparison with the knowledge based 
model. This is achieved by performing the gradient ascent, or "hill climbing'*, 
technique to find the peak power position of the first fiber, as previously described 
5 above. The first possible error using the hill climbing technique is that the positioning 
of the first fiber can occur at a local maximum. This is shown in Figure 12, as both a 
two dimensional intensity contour and a three dimensional figure. The hiU-clknbing 
algorithm is started at a position, denoted by the circle in Figure 12, which is roughly 
half the array pitch spacing, in both the x and y direction, and runs until a maxixnum is 

10 determined. However, as denoted by the line with the symbol in Figure 12, the 
hill-climbing technique "zigzags" and stops at a local maxima (denoted by the square) 
before the global peak power for the first fiber. The peak intensity at this local 
position is 0.0502 (AU). 

In contrast, the knowledge based model discussed above is shown by th.e path 

15 marked with the "*" symbol in Figure 12. From the device model simulation, the 
**feed-forward" control block determines where the maximum power peak will occur 
and sets this initial position in the control loop. In this example, the initial point is 
positioned roughly 5% away firom the maximum value, to simulate the possibility of 
optical modeling errors, eqxiipment misalignments, and/or errors due to manufa-cturing 

20 tolerances. The technique quickly finds the maximum power for coupling to tixe first 
fiber in the array, which is denoted by a star in Figure 12. The peak optical intensity 
found at this peak is 0.2376 (AU), which is an increase of over 370% over the result 
of employing the current method as discussed above. 

Besides finding the global maximum power peak, the technique is more 

25 efficient when compared to the currently used alignment algorithm. Even in this 

simple example, the mmiber of time-steps, or steps tiiat the motors had to take to get 
to the maximum power position, is much less for the knowledge based model (~8 
steps) than the standard hill-climbing technique ('-23 steps), as seen in Figure 13, 
which got caught in a local minimum and did not even reach the peak power po sition. 

30 The time-steps, in essence, reflect the speed of the automation process of the present 
invention. 
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Example 3 

In Example 3, the algorithm for improving the performance of the entire ; 
system is described. The total power captured in the fiber array is exaniined. A 
5 common technique aligns a fiber array by determining the position for the Trnv:?r;:;rr^ 
optical power in tite first fiber, as showed in the example above. The remainder of the 
fiber array is then rotated around this position, imtil the maximum power is captured 
in the last fiber of the array. It is then assumed that tiie rest of the fiber array is 
aligned. 

10 hi this example, it is shown that in aligning a fiber array using this technique, 

the overall performance of the system is not considered. In contrast, the knowledge 
based model control loop of the present invention can take the performance of all of 
the fibers into consideration and thereby provide an increase in total system 
performance. 

15 In this example, the total power of the fiber array is calculated by summing the 

optical intensity at each of the center fiber positions in the array. In the case of the 
hill-climbing technique, if the pcdk position of the first fiber is caught in a local 
maximimi, as seen in Figure 12, the total power of all 8 fibers is calcidated to be 
0.1959 (AU). If the hill-climbing algorithm is allowed the benefit of the doubt that 

20 the true optical peak for the first fiber can be found at the global maximum value, the 
total power calculated for the fiber array is 1 .5296 (AU). 

In contrast, with the knowledge based model approach, the entire optical field 
space can be exanmied by taking a plurality of measurements of optical power at 
different locations, and the position in which a certain alignment will achieve a 

25 maximum performance for the entire system can be determined. The total power is 
calculated for each case, and the optimal position of the fiber array is chosen at the 
point where the alignment gives the best performance for the entire system. In this 
case, it was found to be a maximum power of 2.0380 (AU), at a position offset from 
the first fiber center by about 3 yxm in the x direction. Comparing the instant 

30 invention's technique verses the standard hiU-climbing technique, an improvement of 
over 33% is shown when the hill-climbing uses the peak maximum of the first fiber, 
and over 940% when the hill climbing method gets caught in the local TuaviTTniin. 
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In Figure 14, the positioning of each fiber in the array is shown using both the 
classical technique (centered at the peak power of the first fiber) and the knowledge 
based model technique. It can be seen that the knowledge based model control loop 
(denoted by the shape) is closer to more array peaks than the hill-climbing 
5 technique (denoted by the "o" shape). 

Example 4; Cnnplinyr of an Edge-emitting Laser Diode to an Optical Fiber 

This example highlights some of the advantages of the knowledge based 
model. In this example, coupling of an edge-emitting laser diode to an optical fiber is 

10 shown. This example illustrates one of the most commonly packaged devices using 
conventional optical automation processes. 

A model of device 900 used is seen in Figure 15. In this example, a GaAs 
laser diode 901 is flip-chip bonded onto a silicon bench 903 > containing the electrical 
drivers for the laser, along with a fabricated V-groove 904 for placement of fiber 902. 

15 The V-groove 904 provides "self-alignment" for the fiber 902, however, within the V- 
groove 904, the positioning of fiber 902 is critical to the final performance of device 
900. The arrows 905 represent the 6 degrees of freedom (in both 2D and 3D) in which, 
fiber 902 needs to be aligned. 

In this example, the laser diode emits a broad Gaussian beam, which. 

20 propagates through a 20x20 |xm square aperture to a fiber with a 4 |xm core. The 
aperture is used in this example, to ensure that the power distribution is not a simple 
uni-mode. The distance of propagation between laser-diode and fiber is only lOpm, 
therefore the light has propagated only into the near-field and its 2D intensity pattern 
in an observation plane at the fiber shows diffractive effects, as seen in Figure 16. 

25 This result is determined from the angular spectrum simxilation. 

In order to compare a conventional method and the method used in tiiis 
example, the control loop is first analyzed with the conventional method. The 
conventional automation process determines an initial set point in the V-groove 904 
through the visualization of the fiber 902 to the aperture, ali gning the geometrical 

30 optical axis with the center of the fiber core (at a location of 20 pm in Figure 16). 
From this set point, the gradient ascent algorithm is performed to find the position 
alignment for maximum power coupled into the fiber 902. 

In contrast, the knowledge based model determines the positional alignment 
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for the maximum power coupled into the fiber 902. Therefore, the knowledge "based 
model starts by simulating the entire system to predict the best 'feed-forward" set 
point. The simulation is performed using the angular spectrum technique, as the 
output intensity distribution and a distribution of the power coupled into the fiber 902 
5 are determined. In this example, the feed-forward set point is defined with the 
simulated position of the maximum power (the area undemeath the intensity cxurve) 
captured in the 4 ^un fiber, seen in Figure 17(a). The position is found at (13.8, 13.8 

In Figure 17(b), the fiber is coupled using the conventional technique and the 

10 knowledge based model is compared to the conventional technique. The conventional 
technique starts at a position close to the center of the geometrical optical axis (20,20 
ixm) and uses the gradient ascent algorithm, which stops tiie aligmnent loop at a local 
maximum power, denoted by the ^'X?' in the figure. In contrast, the knowledge based 
model starts at the feed-forward position (13.8,13.8 |Lun) and uses a gradient ascent 

15 algorithm to find the global maximum power coupled into the fiber, denoted by the 
in the figure (actually, in this example, the algorithm starts off of the set point by 
a couple of microns to simulate possible mechanical and system misaligrmients). The 
paths of the gradient ascent algorithms for both the knowledge based model and the 
conventional method are included on the intensity diagram in Figure 17(b). In this 

20 example, an increase of approximately 1 8% is achieved when using the knowledge 
based model, as compared to the conventional automation technique. 

Using the same laser diode-to-fiber coupling shown in Fig. 15, a complete 
simulation of the proposed automation control process is shovm in Figure 18. Again, 
an on-line simxilation is performed at the point of attachment. For these oa-line 

25 simulations, the maximum throughput power for the ideal positional alignment of the 
fiber 902 is determined. This is used as a target or tracking parameter. In this 
simxilation, the angular spectrum optical modeling technique is used, and determines a . 
peak intensity value of 1.41 (AU). The inverse model is calculated with the PWL 
deconstruction as presented in the previous section. Using a simple l/(sH-l) naotor 

30 dynamic, the entire control loop is simulated in MATLAB's™ Simulink. Also 
included in Figure 18, are simulation results, in terms of optical power received, vs. 
time and motor position vs. time. Note for these control parameters, the position of 
the motor setties at a distance of 12.6 )mi, which tracks the goal intensity value of 
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1.41, in approximately 7 seconds. 

From the above examples, the effectiveness of the knowledge based model of the 
present invention can be seen. It is to be understood that even though numerous 
characteristics and advantages of the present invention have been set forth in the 
foregoing description, together with details of the method, the disclosure is illustrative 
only, and changes may be made within the principles of the invention to the full 
extent indicated by the broad general meaning of the terms in which the appended 
claims are expressed. 
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